Matrix Compression using the Nystroöm Method

The Nyström method is routinely used for out-of-sample extension of kernel matrices. We describe how this method can be applied to find the singular value decomposition (SVD) of general matrices and the eigenvalue decomposition (EVD) of square matrices. We take as an input a matrix M ∈ Rm×n, a user defined integer s ≤ min(m,n) and AM ∈ Rs×s, a matrix sampled from the columns and rows of M . These are used to construct an approximate rank-s SVD of M in O ( s2 (m + n) ) operations. If M is square, the rank-s EVD can be similarly constructed in O ( s2n ) operations. Thus, the matrix AM is a compressed version of M . We discuss the choice of AM and propose an algorithm that selects a good initial sample for a pivoted version of M . The proposed algorithm performs well for general matrices and kernel matrices whose spectra exhibit fast decay.